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Abstract 

We  consider  a  standard  ARMA  process  of  the  form  =  &{B)Zt,  where  the 

••••  innovations  Zt  belong  to  the  domain  of  attraction  of  a  stable  law,  so  that  neither 
the  Zt  nor  the  Xt  have  a  finite  variance.  Our  aim  is  to  estimate  the  coefficients  of 
and  0.  Since  maximum  likelihood  estimation  is  not  a  viable  possibility  (due  to 
the  unknown  form  of  the  marginal  density  of  the  innovation  sequence)  we  adopt  the 
so-called  “Whittle  estimator”,  based  on  the  sample  periodogram  of  the  X  sequence. 
Despite  the  fact  that  the  periodogram  does  not,  a  priori,  seem  like  a  logicad  object 
to  study  in  this  non-£*  situation,  we  show  that  our  estimators  are  consistent,  obtain 
their  asymptotic  distributions,  and  show  that  they  converge  to  the  true  values  faster 
than  in  the  usual  case. 
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1.  Introduction 

This  paper  considers  two  closely  related,  but  distinct,  subjects.  We  conunence 
with  the  discrete  moving  average  process 

00 

x,=  (1,1) 

j=-oo 

where  ^  ^  noise  sequence  ofiid  random  variables  (r.v.'s)  having  not  nec¬ 

essarily  a  finite  variance.  Two  preceding  papers  by  Kliippelberg  and  Mikosch 
(1991),  (1992),  studied  the  asymptotic  behaviour  of  periodogram-type  estima¬ 
tors  for  the  process  condition  that  is  in  the  domain  of 

normal  attraction  of  an  a-stable  law  for  some  a  £  (0,2].  In  Kliippelberg  and 
Mikosch  (1992)  it  was  shown  that  the  normalized  periodogram 

n  ^  J  n 

?n,x(A)  =  E  /  E  •  -»<><», 

t=l  /  «=1 

converges  in  distribution  to 

\,I>{X)\^  o»(A)-Hfi»(A) 

00 

where  =  is  the  transfer  function,  and  the 

;=-oo 

vector  (Q(A),fi(A),7^)  has  a  mixed  stable  distribution  such  that  {q{X),0{X)) 
are  jointly  a-stable  and  7^  is  positive  a/2-8table.  F\irtbermore,  the  vector 
of  different  periodogram  ordinates  (/n,x(Ai)]  converges  weakly,  and 

the  components  of  the  limit  vector  have  exponentially  fast  decreasing  tails  and 
are  uncorrelated.  Smoothed  versions  of  the  normalized  periodogram  were  also 
studied,  and  their  weak  convergence  to  the  normalized  power  transfer  function 
IV’(A)|^/V'*  established. 

In  this  paper  we  weaken  the  above  assumptions  on  Zi  considerably:  we  only 

require  that  E  \Zi  |^  <  00  for  some  d  >  0  and  that  {  ^  ZM  satisfies  some 

V«=i  /n>l 

tightness  condition.  Under  such  general  conditions  one  cannot  expect  to  de¬ 
rive  distributional  limits  for  /n,x(A);  but  we  prove  weak  convergence  for  the 
smoothed  normalized  periodogram  to  |d’(A)P/  for  a  large  class  of  smooth¬ 
ing  filters  (Section  3).  In  Section  4  we  obtun  under  the  same  mild  condi- 
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tions  on  the  noise  variables  weak  convergence  of  the  sample  autocorrelations 
A’*  /  2  A,’  to  2  0;+*  V'i  /  V"*  for  h  G  -V. 

«=!  /  1=1  i=-«  / 

In  Section  5  we  turn  to  the  second  and  main  subject  of  this  paper:  parameter 

estimation  for  an  ARM  A(p,  9)-process  of  the  form 

Xt  —  ipi  A|_i  —  ...  —  ipp  Xt~p  =  Zt  +  Zt-i  +  . . .  + 

for  fixed,  known  values  of  p  and  q.  Adapting  an  idea  of  Whittle  (1953)  we  con¬ 
struct  a  weakly  consistent  estimator  fin  of  the  parameter  vector  fi  =  {fi,  -  ■ .  ,ipp, 
■  •  ■ .  Moreover,  if  Zi  belongs  to  the  domain  of  normal  attraction  of  an 
or-stable  law,  a  G  (0,2),  the  rate  of  convergence  is  (n/logn)^^“.  The  proofs  of 
the  results  of  Sections  3-5  are  given  in  Sections  6-9.  In  the  concluding  Section  10 
we  discuss  how  to  use  our  estimator  in  practice,  and  give  the  results  of  a  small 
simulation  study  which  indicate  that  the  estimator  seems  to  perform,  in  prac¬ 
tice,  as  good  as  the  well  known  MLE  estimators  in  the  corresponding  model 
with  Gaussian  innovations. 

2.  Assumptions  and  notation 

We  consider  the  moving  average  process  (At),g2  defined  by  (1.1).  To  formulate 
the  conditions  on  the  noise  {Zt),^2  introduce  the  following  functions  for 
*  >  0 

G(x)  =  P(Z?>r) 

A:(x)  =  x~*EZj/(Z?<x) 

Q(i)  =  G[x)  +  K{x)  =  E  [l  A  (x-»  Z?)*]  . 

Since  Q  is  strictly  decreasing  and  continuous  on  (0,oo)  the  identity 

Q  (®»)  =  ^  •  nS/f,  (2.1) 

defines  a  sequence  of  positive  numbers  a„  such  that  On  T  oo  as  n  — *  oo.  Fur¬ 
thermore,  define 

n 

7n.z  =  a-^^Zf,  n  G  Af .  (2.2) 


OTIC  QUALITY  LNSPECTED  3 


(2.2) 

Accesion  For 

NTIS  CRA&I 
OTIC  TAB 

Unannounced 
Jl/Slific.ii  OT' 

ev  . . 


F\-\ 


ijCL-ciai 
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For  the  moving  average  process  as  in  (1.1)  we  introduce  the  following  assump¬ 
tions;  There  exists  some  d  >  0  such  that 
(Al)  E\Zi\^<oo-, 

00 

(A2)  (i(  IV'jl*  <  oo  for  tf  =  1  A d; 

i=-oo 

(A3)  n/o*^  — *0,  n— *00,  for5=lAd; 

(A4)  lim  limsup  P  (7J  z  <  x)  =  0 . 

*"•0  n-iao  ‘ 

Remarks.  1)  (Al)  and  (A2)  imply  absolute  a.s.  convergence  of  the  series  (1.1) 
for  every  t  E  Z.  This  is  a  consequence  of  the  three-series  theorem. 

2)  (A2)  is  obviously  satisfied  for  every  ARM  A(p,  9)-process.  In  this  case  the  rlij 
decrease  exponentially. 

3)  The  conditions  EZ^  <00,  (A3)  and  (A4)  cannot  hold  together,  since  (A3) 
and  the  SLLN  imply  that  7^  2  “  ^  contradicting  (A4). 

4)  (A4)  is  a  stochastic  compactness  condition  on  7^  2-  ^  necessary  and  sufficient 
condition  for  7^  2  stochastically  compact  is 

lim  inf  K(x)/G(x)  >  0 . 

[e.g.  Mailer  (1981)].  Furthermore,  if  7^  2  stochastically  compact,  then  there 
exists  some  constant  c>  0  such  that  for  all  n  €  AT 

x>0, 

[Griffin  (1983)]  which  implies  (A4). 

A  natural  class  of  noise  variables  to  satisfy  conditions  (Al),  (A3)  and  (A4) 
is  the  domain  of  attraction  of  an  a-stable  random  variable,  which  we  denote 
by  DA{a).  For  the  definition  and  properties  of  ot-stable  r.v.’s,  their  domain  of 
attraction  and  regularly  and  slowly  varying  functions  see  e.g.  Feller  (1971)  or 
Bingham,  Goldie  and  Teugels  (1987). 

Now  if  Zx  €  DA{a)  for  some  a  €  (0, 2),  then  Zf  6  DA{a/2)  and 

lim  G{x)/K{x)  =  (4  —  a) /a . 

9  •  00 

Then  G  is  a  regularly  varying  function  and  the  norming  constants  in  (2.2)  can 
be  chosen  as 

al  =  G“  (n"*)  =  inf  {x;G(x)  <  n~‘}  ; 
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i.e.  G"  is  the  generalized  inverse  of  G.  This  implies  that  =  n^^‘*I(n)  where  L 
is  a  slowly  varying  function  and  7^  ^  some  positive  a/2-stable  r.v.  7^. 

Furthermore,  E\Zi\*  <  00  for  d  <  a.  In  the  following  lemma  we  summarize 
these  relations. 

Lemma  2.1.  Suppose  Zi  €  DA{q)  for  some  a  €  (0,2),  then  (Al),  (AS)  and 
(Ad)  hold  for  some  d  >  0  and  =  n^^‘'Z.(n)  where  L  is  a  slowly  varying  func¬ 
tion.  D 


The  following  notation  will  be  used  throughout  the  paper:  For  any  sequence  of 
r.v.’s  (At), ^2  ^  sequence  of  positive  constants  we  introduce 


-v’ 

in,A 


In.AW 


At 


/«.x(A) 


JoA^v-tIa  = 


lAl 


Itsl 


A  6  (-»■,»]. 


3.  Consistency  of  the  smoothed  normalized  pe- 
riodogram 

Kliippelberg  and  Mikosch  (1991)  considered  Zi  in  the  domain  of  normal  attrac¬ 
tion  of  an  or-stable  r.v.  (Zi  €  DNA{q)),  a  €  (0, 2);  this  means  that  Zi  €  DA{q) 
with  norming  constants  In  that  case  both  the  periodogram  /n,x(A) 

and  the  normalized  periodogram  /n,x(A)  converge  in  distribution  for  every 
A  €  (— S',  t].  a  common  technique  to  obtain  consistency  is  to  apply  some  smooth¬ 
ing  operation,  and  for  In,x{^)  provides  a  consistent  estimator  for  the  nor¬ 
malized  power  transfer  function  |d’(A)p/d>’. 
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Now  we  shall  show  consistency  of  the  smoothed  normalized  periodogram 

|*|<tn 

under  less  restrictive  conditions.  Here  IVn(jk)  ve  nonnegative  weights  at  points 


At  =  A  4-  k/n,  |i;|  <m,n^Af,  satisfying 

m  =  mn  -* oo, 

m„/n-»0,  n— >00, 

(3.1a) 

=  W„(-k), 

1*1  <  , 

(3.1b) 

E  ^-(*)  =  1- 

|*|<m 

(3.1c) 

H|<m 

(3.1d) 

If  At  =  A  +  k/n  ^  (-»,»]  the  term  7„,x  (A*)  in  Tn,x(A)  will  be  evaluated  by 
defining  I„^x  to  have  period  2t.  The  same  convention  will  be  used  to  define 
^  ^  (-».»■]• 

Theorem  3.1.  Suppose  {Xt),^2  V  AoWs.  Then 

f„.xW  -  1V-(A)W,  n-oo.  D 


4.  Consistency  of  the  sample  autocorrelation 
function 


For  h£  Z  define 


where 


Tn,Jir(h)  =  ■in,x{h)hlx 
y{h)  =  7(/»)/V'* 

n-W 

7n.xW  =  o;’  E 

t=l 

oo 

rW  =  E 

^=-00 
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Obviously,  if  £  Zf  <  oo,  7n,x(A)  is  a  consistent  estimator  of  the  autocorrelation 
function  7(h)  of  results  of  Davis  and  Resnick  (1986)  is  the 

following:  For  Zi  £  DNA{a),  a  €  (0, 2),  Zj  syirunetric 

((n/ logn)‘/“  (7„.jr(A)  -  7(A))) ^  - 


;  (7(i  +  A)  -  7(i  -  A)  -  2y(j)  7(A)) 


V . . ' 


(■1.1) 


where  Yq,  Yi.yi, ...  are  independent  r.v.’s,  Yq  is  positive  a/2-stable  and 
are  iid  standard  oi-stable.  (4.1)  implies  that  7n,x(A)  is  weakly  consistent  with 
limit  7(A)  and  the  rate  of  convergence  is  faster  than  in  the  finite  variance  case. 
Under  our  more  general  conditions  (A1)-(A4)  a  precise  result  as  (4.1)  cannot 
be  expected  but  we  prove  weak  consistency. 


Proposition  4.1.  Suppose  {Xt),^2  (^l)'(^4)>  fAen 

7ii.x(A)  7(A),  ke/if,  n-*oo.  D 

As  shown  in  the  appendix  by  replacing  conditions  (A3)  and  (A4)  by  a  slightly 
more  restrictive  condition  it  is  possible  to  obtain  a.s.  convergence  of%^xW  to 
7(A)  along  some  known  subsequence.  In  particular,  this  condition  is  satisfied 
for  Zi  €  DA(a),  a  €  (0,2).  Moreover,  we  give  an  example  to  show  that  a.s. 
convergence  need  not  hold  in  general  under  (A1)-(A4). 


5.  Parameter  estimation  for  AKMA{p,q) 
processes 

We  consider  a  causal  invertible  ARMA(p,9)  process  (At),^^  satisfying  for  ev¬ 
ery  t  the  ARMA  equations 

Xt  -  <Pi  Xt~i  —  ...  —  (fip  Xt-p  =  Zfi-ffi  Z,_i  •+  ...  +  9p  Z,_, 
for  iid  Denote 

<p{z)  =  1  -  r  -  . . .  -  s' 

9(2)  =  1  +  2  -1- . . .  +  2* 
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and 


Then  in  the  infinite  moving  average  representaion  of  our  process  we  have  that 
V>(A)  =  v»(e-‘*)/tf(e-‘*). 

We  introduce  the  parameter  set 


C 


#  0 ,  fiy  ^  0 ,  ^(r)  and  B{z)  have  no  common  zeros , 
B(z)  ^0  for  |z|  <  l}  . 


Denote  by  g(A,  0)  the  power  transfer  function  corresponding  to  0  £C;  i.e. 


«(>,/?)  = 


tf(e-^) 


=  |^(A)p 


and  define 


■^n.x(A>) 


where  the  sum  is  taken  over  all  Fourier  frequencies 

=  V  " 

Clearly,  as  n  — »  oo,  the  sum  and  the  integral  should  converge  to  the  same  limit. 

Suppose  ^0  €  C  is  the  true,  but  unknown  parameter  vector.  Then  two  natural 
estimators  of  0q  are  given  by 


0„  =  argmin  <r*(/3),  0„  =  argmin  dl(0) . 

Dec  Dec 


Given  the  assumption  that  <t\(0)  ~  B^{0),  it  seems  reasonable  to  assume, 
as  is  in  fact  the  case,  that  0n  "  0n,  and  that  therefore  the  two  estimators  are 
asymptotically  equivalent.  It  is  clear  that,  in  practice,  0n  is  the  only  applicable 
estimator,  since  the  integral  defining  ff^{0)  will  always  have  to  be  evaluated 
by  an  approximating  sum.  Nevertheless,  throughout  this  paper  we  shall  give 
proofs  of  convergence  for  the  estimator  based  on  (ri{0),  since  here  the  notation 
is  much  lighter. 

The  choice  of  these  estimators  is  motivated  by  the  fact  that  the  function 


g(A,igo) 

g(A.^) 


dA 
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has  its  absolute  minimuin  at  ^  >»  C.  [cf.  Brockwell  and  Davis  (1991), 

Proposition  10.8.1.].  Moreover,  by  Theorem  3.1.,  In,xW  applied  to 

estimate  g  (A,  /9o)/  (^o),  where  0’  {fio)  is  the  quantity  corresponding  to  fio. 

For  Gaussian  the  estimator  fin  is  closely  related  to  least  squares  and 

maximum  likelihood  estimators  and  it  is  a  standard  estimator  for  ARMA  pro¬ 
cesses  with  finite  variance.  The  idea  goes  back  to  Whittle  (1953),  see  also  Dzha¬ 
paridze  (1986),  Fox  and  Taqqu  (1986)  and  Dahlhaus  (1989).  It  is  well-known 
that  in  the  classical  case  fin  is  consistent  and  asymptotically  normal  [cf.  Brock- 
well  and  Davis  (1991)].  We  show  that  fin  is  also  for  ARMA  processes  with 
infinite  variance  a  weakly  consistent  estimator  for  the  true  parameter  vector  fio- 

Theorem  5.1.  Suppose  {Xt)t^z  "  causal  invertible  ARMA(p,q)  process  and 
conditions  (AJ)-(A4)  hold.  Then 

fin  ^  fio  Md  alifin)  ^  {fio)  ,  n-*oo. 

Furthermore,  the  same  limit  relationships  hold  also  for  fin  and  .  □ 

As  shown  in  the  Appendix,  it  is  possible  to  obtain  a.s.  convergence  along 
some  specified  subsequence  under  more  restrictive  conditions  which  hold  e.g. 
for  Zx  €  DA{a),  a  €  (0,2). 

For  ARMA(p,9)  processes  with  finite  variance  fin  is  asymptotically  normal 
with  rate  of  convergence  of  order  An  analogous  result  gives  in  our  case 

a  rate  of  convergence  of  order  (n/logn)'’’^“:i.e.  the  convergence  is  considerably 
faster  (since  a  <  2). 

To  obtain  a  representation  of  the  limit  vector  we  restrict  ourselves  to  sym¬ 
metric  Zi  €  DNA(q)  for  o  €  (0, 2)  such  that 

n 

s  Y  (5.1) 

«=j 


where  Y  is  a-stable. 

Recall  that  a  random  variable  Y  is  said  to  have  a  stable  distribution  (Y  = 
Sa{<^,0,y))  if  there  are  parameters  0  <  o  <  2,  >  0,  -1  <  ^  <  1,  and  /i  real 

such  that  its  characteristic  function  has  the  form; 


E{e'*^) 


exp  {-^*191®  (1  -  t/9(sign9)  tan  +  t/i9} 
exp  |-«r(9(  ^1  d-  ^(sign  9)  In  |9| j  i/i9| 


if  o  9^  1. 
if  or  =  1. 
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If  =  /i  =  0  then  y  is  symmetric  and  we  say  that  Y  has  a  “symmetric  a  stable” 
distribution,  denoted  by  y  =  SaS- 
For  later  use,  let  C*  be  the  constant  defined  by 


Ca 


ifa?^  1 
if  a  =  1. 


(5.2) 


Theorem  5.2.  Suppose  process  and  (Zx\^2 

symmetric  such  that  (5.1)  holds.  Then 

-  4xty-‘(fio)  ^  gnft*.  (5.3) 

where  yo.yi.yj,.--  are  independent  r.v.’s,  Yo  =  Sa/2(C;//“,  1,0)  is  positive 
all-stable,  (y«),gjw.  parameter  a  =  Ca”,  (fio)  « 

the  inverse  of  the  matrix 


ond,  /or  k  eM,  bt  is  the  vector 


.  1  /*  -liA  /I  />  \  jx 

*‘  =  2;  /./ 


Furthermore,  (5.3)  holds  also  with  replaced  by  □ 


The  limit  vector  in  (5.3)  is  the  ratio  of  an  a-stable  (p  +  g)-dimensional  vector 
over  a  positive  a/2-stable  r.v.  It  is  not  difficult  to  see  that  for  AR(p)  processes 
0n  is  just  the  formal  analogue  of  the  Yule- Walker  estimates.  Their  weak  limit 
behaviour  was  derived  by  Davis  and  Resnick  (1986)  using  time  domain  methods. 

In  closing  we  note  that  “more  rapid  than  Gaussian”  rates  of  convergence  for 
estimators  in  heavy  tailed  problems  seems  to  be  the  norm  rather  than  the  excep¬ 
tion.  For  example,  Feigin  and  Resnick  (1992,  1993)  study  parameter  estimation 
for  autoregressive  processes  with  positive,  heavy  tailed  innovations,  and  obtain 
rates  of  convergence  for  their  estimator  of  the  same  order  as  ours,  but  with¬ 
out  the  logarithmic  term.  Their  estimators,  however,  are  different  to  ours  both 
in  spirit  and  detail,  and  involve  the  numerical  solution  of  a  non-trivial  linear 
progranuning  problem. 
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6.  Auxiliary  results 

We  shall  frequently  make  use  of  the  following  decomposition  of  the  periodogram. 
Its  proof  is  given  in  Proposition  2.1  of  Kliippelberg  and  Mikosch  (1991). 

Proposition  6.1.  Sappose  “  moving  avenge  process  as  in  (1.1)  and 

(A.l),  (A.S)  are  satisfied.  Then 

In.xW  =  IlfrWP  /n.z(A)  +  fe„(A) ,  -r  <  A  <  » 

where 

R„(\)  =  V'(A)J„{A)y„(-A)  +  V-(-A)  J„(-A)y„(A)  +  |y„(A)|^ 

n 

■^n(A)  =  e-*^‘ 

1=51 

E  l/n;(A) 

j=-oo 

t'ni(A)  =  2  ° 

tsi-i  1=1 

The  following  Lemma  is  similar  to  Davis  and  Resnick  (1986),  p.  549,  see  also 
Lemma  5.1  of  Kliippelberg  and  Mikosch  (1992). 

Lemma  6.2.  Suppose  satisfies  (A1)-(A4),  then 

=V'^72.z(l  +  Oi»(l)),  n  — 00. 

Proof. 

ilx  =  E  E  *  E  E 

t=l  js-oo  1=1  i:^} 

=:  Vi  +  V,. 

Then  the  triangle  inequality  gives 

i*} 


0 
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>:s-oo 

oo 

<  2a;'  ljl^^l^il'-0.  O 


Lemma  6.3.  Let  {Zt),^2  ^  ^  scfttcnce  of  iid  r.v.’s.  Then  the  following  rela¬ 
tions  hold  for  n  — *  oo; 


E  Z\  Zl  =  0  (i 

0 

(6.1a) 

(h)  If(Al),  (AS)  and  (A4)  hold,  then 

E  Z\  Xi  ~ 

. 

(6.1b) 

E  Z2  Z3  — 

o{n-^)  , 

(6.1c) 

E  Z\  Z2  Zz  Zdk  ~ 

o(n-*)  . 

(6. Id) 

(c)  If  (Al)  and  (A3)  hold,  then 

0,  A  gaz’d. 

n(n  -  1)E  Zl  ZI^eJ^  ^  ^  (E  ^'1  =  ^  ’ 

«,•«!  XlSSl  / 


E  o;2  ^  Z,  Zt^H  <  a;“(n  -h)E  \Z,  Z^l'  ^  0 . 
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n— 1  ^ 

2  Zt  Zt+i 
t=i 


/el,  tiEAf,  thus  the  sequence 


(b)  By  Holder’s  inequality, 

(  ^  Zi  ^1+1 )  is  uniformly  integrable 
V‘=i  /ngjV 

Part  (c)  and  (A4)  imply  that 

Zt  Zt+i  =  z  a~®  Zt  Zt+i  ^  0 . 

»=i  «=i 

Hence 

n-l 

E  Zt  Zt+i  =  (n  —  1)  £  Zi  Zj  — »  0 . 


t=i 


This  proves  (6.1b).  The  proofs  of  (6.1c)  and  (6. Id)  are  similar;  we  only  prove 
(6.1d); 


([n/2]  -  l)(n  -  [n/2]  -  1)  E  Zi  Z^  Z3  Z, 


£ 


[n/Jl-l 

<sl 


n~l 

E 

»=[n/2j+l 


[n/2) 

E^?+ 


«=i 


<={n/2j+l  J 


[n/2]-l 

E  ^‘+1 

«=i 

n-l 

E 

«=[n/2]+l 

i"/>i 

(Si 

Cj 

n 

E 

t=[n/21+l 

0 


by  (6.1c).  O 

7.  Proof  of  Theorem  3.1. 

As  a  structural  part  of  Tn,xi^)  define 

Ci»  :=  E  W’’„(fc)cosAt(t  -  s) 

|t|<m 

and  prove  some  asymptotic  relations  for  n  — »  oo. 


Lemma  7.1. 
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('•‘J 

E  ‘^‘*=0(1). 

I,*  =  l 

(h) 


fl 


E 

I 


e 


3 

t» 


(<^) 

n  n  n 

52  <=<'■ = o(")  •  52  ®  (”^)  >  52  ~  ®  (”*)  • 


Proo/.  (a) 

52  ci,  =  52 52'^°®^*(‘“*) 

t,<  i*i<'"  '•* 


cosA*!^  +  ^y^sinAtfJ  |=0(1). 

(b)  <^1  =  S  result  follows  from  equation  (6.2)  of  Kliippelberg 

and  Mikosch  (1992). 

(c)  Using  trigonometric  sum  formulas  we  obtain 

52 


«,*,r 


<  52  iv„(/fci)  ^V„()t2)|52cosAt.(t-s)  cos  Ai,(<  —  r) 


\*,Kr 


<  52  »^n(*i)  w'»(*2)<  52'^'*''*‘*‘^°®''*»*52‘^“‘^**®52‘^°®''*»’ 

|*,l.l*,|<m  V  I  «  *  r 


5^  cos  At,  t  sin  Atjt  52  ^  ^*3  *’ 
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^  sin  A*,  <  cos  ^  sin  A*,  s  ^  cos  At, r|  I 


<  (  X)  J^n(i2)]  rfon  =  0(n 


for  some  constant  do  >  0.  F\irthermore,  there  exist  constants  di,  dj,  do 
such  that  hy  (a)  and  (b) 

Ctr  =  ^  Cft  Cfr  +  dl  cf,  +  dj  ■*"  ^ 


‘9S*9«r 


t,<,r 


(7.1) 


—  Cir  +  di  n  +  ^2  ^  c,r  +  da  ^  c*, 

»,*,»•  <,r  l,t 

=  o(n^). 

That  the  sum  ^  C|,  Cr„  =  O  (n*)  follows  similarly.  □ 

We  apply  Proposition  6.1.  and  Lemma  6.2.  to  T„_x  &nd  obtain 
^n.x{A)  =  W„(k)Z,,x(^k) 

|t|<m 

|*|<m 

+  E  W'n(*)«n(A0}  (l  +  Op(l))  . 

l»l<m 

Since  max  (A*  —  A(  — »  0  as  n  — »  oo  and  |^(A)p  is  uniformly  continuous, 

|t|<m 

|l^(At)|"-|V-(A)p|-0.  n 

Thus  we  conclude  that 

Y^  W„(*)|V(A*)|'  7n.z(As)  =  (l  +  o(l))|^(A)p  Y^  W„(k)l,2(Xt) 

|*|<m  |*|<TO 

=  (l  +  o(l))|V-(A)p  (l  +  Q„(A))  . 


max 
\k\<m  I 


■  00. 


_  n 

QnW  =  Y2  *^»(*)  X)  -  *)  • 


l*l<m 


f.tsl 


where 


(7.2) 
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p 

Lemma  7.2.  Qn(A)  — »  0,  n  — *  oo. 

Proof.  We  prove  E  — »  0  as  n  — ►  oo:  There  exist  constants  di,  dj,  ds 

such  that 

On(A)  =  Zt  Z]  +  rfj  X) 

<9«J  (/<^r 


+  ds  Cf,  Crv  Z,  Zr  Zy  , 

and  the  result  follows  from  Lemmas  6.3.  and  7.1.  □ 

In  view  of  (7.1),  (7.2)  and  Lemma  7.2.  it  remains  to  prove  that 

7„*.|  E  Wn(k)R^(\t)^0. 

\k\<m 

By  the  decomposition  of  Proposition  6.1.  and  by  Holder’s  inequality,  we  have 
for  some  constant  c>  0 


E  ^»(*)  (^‘) 


<  C 


(e  fx 

/  \I*IS 


>/» 


E  »^»(*)  I’'-  (^*))* )  +  E  I''" 


By  (7.2)  and  Lemma  7.2., 


7n^  E  (''*)!’  =  E  (^*)  =  > 

|fc|<m  ti|<m 

hence  it  suffices  to  show  that 

Hl<m 

By  the  decomposition  of  Proposition  6.1.  we  have 

|yn(A*)l^<2(>lu+A20 


(7.3) 


where 


Aik  —  a, 


-a 


E  V-te-*‘'l/„.(Ai) 


|»|>n 
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2 

l«l<* 

Lenuna  7.3.  y~%  ^  Wn{k)  Au  ^  0. 

|*|<m 

Proof.  We  have  for  some  c  <  oo 

53  Wnik)A,k<c{V,  +  V2) 

l*|<m 

where 

II  t  * 

Vi  =  a;*  53  w«(*)  53  e-"‘‘  £  Zr 

|*(<m  |«|>n  r=l-t 

2 

V2  =  a;»  53  W„(*)  53  V-.  e-^‘‘  /».2(A0 

|»l<m  |«|>n 

Note  that 

vz  ^  1 E  I  E  ^»(*)  • 

\Ml>n  /  ltl<m 

By  (A4),  it  remains  to  show  that  Vi  0.  We  restrict  ourselves  to  prove  that 


Vn  =  a;’  53  W„(k)  530,e-‘*“  ^  Zr 


|t|<m  |t>n 

r=l-«  1 

-1 

2 

n-» 

=  5^  Wn(k)  53  Z,  e- 

-tA»«  ^  g-iA»r  4  Q 

m<m  l=-oo 

r=(n+l)A(l-l) 

We  have  for  some  positive  c 

i 

<  a-*E  ^»(*) 

E  i^«i  E 

|*|<in  ’ 

^(=-ao  rs(n-i-l)A(l-t)  / 
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= 


-1 


E  1^*1  E 

!t=-oo  rs(n+l)A(X-l) 


-1  n-l 


<  c««'  E  E 

t=-oo  r=(n-«-l)A(l-t) 


<  Cfln*  E  1*1 

f=£-ao 

and  an  application  of  Markov’s  inequality  proves  Kn  — >  0-  O 
Lemma  7.4.  ^  1V„(1:)  Ajt  ^  0. 

|»|<m 

Pnof.  In  view  of  (A4)  it  suffices  to  show  that  ^  Wn(k)  Au  0.  We  restrict 

|*|<m 

ourselves  to  show  that 


V3  =  a;’  52 

|t|<m 


=  E 

|*l<m 


«=r 


n  /  0 

E 

«=i  \r=i-« 


Z,  e-^*‘  -  ^  Zt 


/sn-(-fl 


We  have  for  some  positive  c 

<  <in*E 


Ei^«ifEi^^i+  E 

«=l  \/=l-«  r=n-l+l  / 


<  co;‘  52  1*1 

oo 

p 

Markov’s  inequality  proves  V3  -♦  0.  D 
Finally  we  combine  Lemmas  7.3.  and  7.4.  which  gives  (7.3);  this  proves  The¬ 


orem  3.1.  O 
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8.  Proof  of  Proposition  4.1. 

We  mimic  the  proof  of  Davis  and  Resnick  (1986),  pp.  548-550.  For  any  h  eAf 
we  have 

^ X,  -  y{h)  (^i+*  -  t(A)  V-i) Z,.i  Zt.j 

.=1  ^  «=i 

+ E  E  (^•+*  -  =■ 

t=i  t 

where  we  used  the  fact  that  ^  (^i+h  —  7(h)  V>i)  =  0.  By  (A1)-(A3)  we  obtain 

t 

for  some  c,-  >  0,  i  =  1,2, 3,4. 

E  \a~^  Vi|'  <  Cl  n  a~^‘  ^  l^ii,  (0,+*  -  7(A) 

<  C2»ja~”  —  0, 

and 

E  |a;’  <  C,  o;*  E  (^•+»  “  yW  l«l 

f 

<  C40;*  -►  0. 

By  Markov’s  inequality  this  implies 

«;*(Vi-»-V2)  4  0.  (8.2) 

Furthermore,  by  Lemma  6.2. 

7n.X  =  *  7n,z  (1  +  o/>(l))  • 

This,  (8.1),  (8.2)  and  (A4)  imply  that 

E  Xt  X,+H  -  7(h)  E  E  ^‘+* 

7n.x(h)-7(A)  =  ^ - S - - - 

E^«* 

tsi  tsl 
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V'l  +  yi 

tsl 


tsl 


=  Op(l)  • 


In  the  latter  relation  we  also  used  (A4)  together  with  the  fact  that 

fl 

®n  *  53  ^  ®  ° 

tsffi  — ib4‘l 


(8.3) 


9.  Proofs  of  the  results  in  Section  5 

The  proofs  in  this  section  are  modelled  on  those  in  the  finite  variance  case,  due 
initially  to  Hannan  (1973).  [cf.  the  treatment  in  Brockwell  and  Davis  (1991), 
Section  10.8,  which  we  follow  closely].  The  technical  differences  in  the  infinite 
variance  case  are,  however,  substantial. 

Throughout  this  section  we  shall  treat  only  the  estimator  0n,  based  on  min¬ 
imising  an  integral  of  the  integrated  periodogram.  The  estimator  ,  based  on 
the  summed  periodogram,  can  be  treated  similarly.  Unfortunately,  as  in  the 
Gaussian  case,  there  seems  to  be  no  easy  way  to  exploit  the  "obvious”  asymp¬ 
totic  equivalence  of  0n  &nd  ^n>  so  as  to  obtain  the  consistency  ruid  asymptotic 
distribution  of  one  directly  from  the  other.  Since  a  full  proof  of  this  equivalence 
involves  treating  the  differences  between  the  higher  order  terms  in  the  Taylor 
expansions  of  —  Pe)  &nd  -  0o),  &nd  this  is  no  easier  than  deriving 
the  results  for  0n  directly,  we  refer  the  reader  to  the  thesis  Gadrich  (1993), 
where  essentially  the  same  arguments  used  below  for  /?„  are  applied  to  ■ 

We  start  with  some  auxihary  results. 

Lemma  9.1.  Suppose  (Xi),£2  ‘  causal  invertible  ARMA(p,q)  process  and 

conditions  (A1)-(A4)  hold.  Then  for  every  ^  €  C 


(9.1) 
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end  for  every  6  >  0 

I*  («-“)!’+« 

an^  _ 

Proof.  We  rcatrict  ourselves  to  prove  that  (9.2)  is  satisfied.  The  proof  of  (9.1)  is 
analogous.  We  adopt  the  proof  of  Proposition  10.8.2  in  Brockwell,  Davis  (1991). 
We  define 

ii;  E 

i=o  l*l<i  l*l<"* 

where 

Fix  c  >  0.  Then  there  exists  some  m€^f  «uch  that 

for  all  {X,P)  e  (-».»]  X  Hence 

<ti^)  -  f  JnMX)  ?m(A.  0)  rfA|  <  ^  y_'  InMX)  dX  =  e/2,  v;?  €  r . 
Hence  for  fixed  t 

<  P  fsup  I  /  ln,x{X)qm{X,0)dX  -  i>~\0o)  -  5I 
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The  first  summand  on  the  rhs  converges  to  tero  in  view  of  Proposition  4.1. 
and  because  the  are  uniformly  bounded  for  ?  and  m  fixed.  The  second 
sununand  is  zero  provided  m  is  chosen  sufficiently  large  ( see  p.379  in  Brock  well, 
Davis  (1991)).  □ 

Proof  of  Theorem  5.1.  We  adapt  the  proof  of  Theorem  10.8.1  in  Brockwell  and 
Davis  (1991).  We  suppose  that  fin  Qof  converge  in  probability  to  fio.  We 
have  by  Lemma  9.1.  that 

P(<rli0n)  <t)>  P(elifio)  <t)~^  P{2irrl>-\fio)  <  t).  (9.3) 

for  every  t.  By  the  Helty-Bray  theorem  and  the  compactness  of  C  there  exists  a 
non-random  subsequence  such  that  converges  in  distribution  to  a  random 
variable  fi  which  is  different  from  fio  on  a  set  of  positive  probability.  The 
functional  F(/,  z)  =  /(z)  mapping  C(C)  x  ?  to  is  continuous  where  C(U)  is 
the  space  of  continuous  functions  on  ?  equipped  with  the  supnorm.  According 
to  Lemma  9.1. ,«■*  ,(•)  converges  in  probability  to  i>~^{fio)  /I,  Hence 

^  is  tight.  Since  fi„^  -i  fi  the  sequence  fin^  is  tight  as  well.  Thus  «i/®n») 
is  tight  in  C(C)  x  C  and  there  exists  a  further  subsequence  (we  use  nt  for  the  ease 
of  notation)  such  that  converges  in  distribution.  By  the  continuous 

mapping  theorem  we  conclude  that 

Thus  we  have 
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P{rl>-\0o) 


r  g(A.^o) 

-rr 

=  p{r\0o)  r 


dA  <t) 


<tj  =  0o)  + 


0) 


dX>27C,0:^0o) 

d\<2r,0i^0e) 


Choosing  6  close  to  zero  the  last  summand  can  be  made  arbitrarily  small.  Thus 
we  conclude  that 


limsup  P(<r2  J  <  t) 

k^OO 

<  W*(^o)2»  <  t.0  =  0c)  +  P(r\0o)  r  <t,0^  0c) 

J-n  9(^,0) 

<  Pi^~\0o)2ir<t,0  =  0c)  +  Pirl>-‘‘{0c)7x<i,0i:0c)  (9.4) 

Now  choose  t  =  2*’V’"’(^o)-  We  obtain  from  (9.3)  and  (9.4)  that 

1  =  P{il>-\0o)2ir  <t)<  P{rl>~\0c)2i,  <t,0  =  0c) 

which  yields  a  contradiction  since  the  event  {0  0c)  has  positive  probability, 

a 


Lemma  9.2.  Suppose  ike  assumptions  of  Theorem  5.S.  hold.  Furthermore,  let 
r}  be  a  continuous  function  on  [— )r,T]  such  that 

(io^)  /  «-►<» 

Then 

(WA)-t^-’(i3o)  9  (A.  0c)  7„.z(X))  r,(A)dX-^0. 

Proof.  Set  *„  =  (n/logn)‘^®  and  note  that  On  =  cn'/“  for  some  constant  c>  0. 
By  the  decomposition  of  Proposition  6.1.  and  Lemma  6.2.  we  get 

J  Jn.xWr}(X)dX  =  ^-^{0o){l+op[\))  j' y-%In,x(X)vWd\ 
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=  r"(A.)(l  +  op(l))^*  rn.z(A)g(A,A,)  ,,(A)dA 

+  (^o)  (1  +  0,(1))  7-^  R.W  17(A)  dA . 

By  the  assumptions  it  suffices  to  show  that 

*n  f  /2„(A)  17(A)  rfA  =  0,(1). 

We  apply  Holder’s  inequality  and  obtain  for  some  c  >  0 
y'  H„(A)  T7(A)dA|  <  c y'  |ii„(A)|  d\ 

<  c I  7„.2(A)  dA) (y'  iy„(A)|»  dX^ +  y'  |y„(A)|*  dAj  . 
Thus  it  remains  to  show  that 

*i/jy»(A)PdA  0. 


We  have 


=:  cn-*/“(yi  +  ya  +  V3  +  yi)  . 

It  suffices  to  show  that  the  Vi  are  stochastically  bounded.  We  will  show  this  for 
Vi-  The  other  estimates  are  similar.  Note  that  Vi  =  |Q(A)|^dA  where 


QW  =  E  E 

ia-oo  «=(n+l}A(l-» 
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Let  Bi  and  82  be  two  independent  Brownian  motions  on  [— x,  x]  and  suppose 
that  they  are  independent  of  (Zt).  Then 

=  £  ^e"  I  ^ 


=  E  lE 


=  E 


(Z,) 


((R*(0(*)))*+(Im(0(A)))>)iAy'V, 


(Zt) 


=  £e-T‘'‘. 


Here  Ni,N2  are  i.i.d.  standard  Gaussian  r.v.’s  independent  of  (Zt). 

In  order  to  show  stochastic  boundedness  of  Vi  it  thus  suffices  to  prove  that  the 
real  and  the  imaginary  parts  of  /*,  Q{X)dBi{X)  are  stochastically  bounded.  Wc 
restrict  ourselves  to  the  real  part. 

We  introduce  the  gauge  function  Aa  for  any  r.v.  A  by 

Aa(A)  =  ^sup  P(|A|  >t)y  . 

Then  for  any  sequence  of  real  numbers  we  have  for  some  constant  >  0 

<caEio<rA:(Zo) 

\»=1  /  •=! 

[see  e.g.  Kliippelberg  and  Mikosch  (1991),  Lemma  3.4].  Then  for  fixed  e  >  0 

p(|y'Re(g(A))dB,(A)|>f) 


<  «-“£ 


H8ups<*p(  53  Z,  V  r  8je(e-‘^^**^AdB,{X) 

\  i=-oo  »=(n+l)A(l-7) 


>  S 
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-1 


<  eMZo)  ^ 


JS-00 


^  tt>,  r  Re  dBi 


l=(n+l)A(l-i) 


=  CaA:(Zo) 

-I 


i=-oo  \l=(n  +  l)A(l-i)  / 

S  C  |V'>l“''‘y  <  OO 


«/J 


J=-00 


Here  (Nj)  is  a  sequence  of  identically  distributed  (but  dependent)  Gaussian 
r.v.’s  and  c  is  a  positive  constwt.  In  the  last  step  we  made  use  of  condition 
(A2).  This  proves  the  stochastic  boundedness  of  Vj.  □ 


Lemma  9.3.  Suppose  the  assumptions  of  Theorem  5.2.  hold.  Furthermore,  let 
t)  he  an  odd  continuous  function  on  [—*’,«']  and  the  Fourier  coefficients  fi, 
k  &  2,  of  Ti(X)  g(X,SQ)  satisfy  l/tl"  <  oo /or  some  p  e  (0, 1  A  a).  Then 

ksz~oo 

(i^;) "7.'. 

where  Vo,  V) ,  Vj,  •  •  •  are  independent  r.v.  ’s,  Yo  is  positive  a/2‘Stable  and 
are  iid  symmetric  a-stahle  with  ch.f.  Fe*‘^‘  =  <  £  72. 


Proof.  We  adapt  the  proof  of  Proposition  10.8.6  of  Brockwell  and  Davis  (1991). 
In  view  of  Lemma  9.2.  it  suffices  to  show  that 


fn,z(^)  VW  9  (^i  ^o) 


where  r„  =  (n/logn)*'^®.  Set 


and 


xW  =  *}W9{\fio) 


xm(A)  =  E  • 

w— » 


lt|<m 
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The  assumptions  on  (ft)  imply  that  uniformly  in  A 

Xm(A)  -*  x(A)=  52  Ac'**,  m  — 00. 

iss-^OO 

Moreover,  /o  =  0.  We  show  that  for  all  £  >  0 

lim  limsup  p(xn\f  A, 2(A)  (x(A)  -  Xm(A))  dAl  >  e)  =  0 .  (9.5) 

For  n£j/  and  h  €  2  we  set 

n-|a|  /  n 

r„.2(A)  =  r„.2(|A|)  =  52  Z.+IA,  /  52 

1=1  /  t=i 

and  y„  =  (n  log  n)*^“  .  Then  for  n  >  m  there  exists  some  ci  >  0 
Vi  =  x„y' 7„.z(A){x(A)-y„(A))dA 


•  ••/■.( 


52  7n,2(A)  e-"*  /*  1 

|fc|<n  (*!>'" 


•) 


=  *n  2x  52  7'' 

m<|h|<n 

r  n-J  n-a  ^ 

Ihsm+l  «=1  ) 


1=1  A=m+1 

=  Cl  7n.2  yn  *  E  !E  7a-« 

t=l  h=m+t+l 


=  ci7->^2- 

Since  7*  ^  7*  for  some  positive  a/2'8table  r.v.  7®  for  (9.5)  it  suffices  to  show 

that  for  every  c  >  0 


lim 

m— *00 


limsup  /’(IV2I  >  e)  =  0. 

n-*oo 
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An  application  of  Theorem  3.1  of  Rosinski  and  Woyczynski  (1987)  yields  for 
some  C2  >  0 

P(|V2|>£)<C2i  E  + 

1=1 

Note  that  for  x  €  (0, 1), 

*<*  (l  +  log+  <*" 


where  p  €  (0, 1  A  a).  Hence  for  constants  cj,  C3  >  0 

n-m^l  n 

n 


p(iv2i>.)  <  ±  lA-.r 


1=1  h=m+l+l 


<  C3-  E  (n-/)  |/rr<C3  Yi  l/'l" 

fl 


and,  by  the  assumptions,  the  rhs  converges  to  0  as  m  — »  00.  This  proves  (9.5). 
Now  it  remains  to  show  [cf.  Proposition  6.3.9  in  Brockwell  and  Davis  (1991)] 
that  ^ 

V3  =  x„  r  7„.2(A)  XmW  dX  ^  2^  E  vT  •  (9  6) 

•'-»  |k|<m  ° 


For  n  >  m  we  have 

V3  =  x„ 


/■(e- 

•'-»  \|M<n 


zW  Y  « 

|t|<m 


ikk 


dX 


=  x„  2ir  %.zW  fh 
\h\<m 


=  Y  7a 

|A|<m 


Zi  Zi^.\h\ 

J 

Theorem  3.3  of  Davis  and  Resnick  (1986)  gives  for  h  >  0 


(n-|A|  \ 

Vn*  S  ‘^«+|A|  j  • 


fin  Z  .  Vn*  E  (Yo,Yl,  ■  ■  ■  ,Yh) 

\  '  t=l  ‘=1  / 


EstimatioJi  for  infinite  variance  ARMA  models 


28 


The  specific  scaling  constants  in  the  statement  of  the  lemma,  and  in  Theorem 
5.2,  then  follow  from  the  representation  of  the  Yi  given  in  Davis  and  Resnick 
(1986)  and  the  results  of  Le  Page  (1980). 

This  together  with  the  continuous  mapping  theorem  proves  (9.6).  O 

Proof  of  Theorem  5.2.  We  adapt  the  proof  of  Theorem  10.8.2  of  Brockweli  and 
Davis  (1991).  A  Taylor  expansion  gives 

80  ~  80  00^ 


=  -(^n-^o) 


00^ 


for  some  0^  with  ||^  —  ^n||  <  \\0n  —  0o\\  where  ||  •  ||  denotes  the  Euclidean 
norm.  Now 

d\ 


80^ 


80^ 


p 

and  since  0^  — »  0q  similar  arguments  as  in  the  proof  of  Lemmas  9.1.  yield  that 


dW(0;)  p  .,-2 

000 


r\0o)  /_/(^.^o) 


Following  the  lines  of  the  proof  in  Brockweli  and  Davis  (1991)  after  (10.8.39) 
the  same  arguments  lead  to 

-  r\0o)  W{0o)  .. 

Hence  it  suffices  to  show  that 

60  ^  Yo 

where  6*  is  defined  in  Theorem  5.2.,  or,  equivalently,  by  the  Cramer- Wold  device 
that  for  adl  vectors  c  € 


Yo 


Estimation  for  infinite  variance  ARMA  models 


29 


We  have 


dan  m 


dg-^{X,0o) 


80 


where 


£7.,xW  - 


dX 


ia  an  odd  continuous  function.  Furthermore,  it  is  not  difficult  to  see  that  the 
Fourier  coefficients  of  ri(X)g(X,0o)  satisfy  the  conditions  of  Lemma  9.3.  An 
application  of  this  lemma  implies  that 

*n  r  7„,x(A)  vW  dX  -1  4s  r\0r>)  E  ^  A 

J-r  >0 

where  /*  are  the  Fourier  coefficients  of  f/(X)g(X,0o);  i  c. 


Thus 


Xn  C 


.T  i 

80 


1  r  .-ak  .Tdg-HK0o) 


80 


g{X,0o)  dX 


for  all  c  €  This  implies  that 
_  8<rl{0c) 


80 


1=1 


t  4s  V’”^/?o)E  ^ 


where  6*  is  the  vector 

1  r  .-^Ai  8g-HK0o) 


2v 


/: 


80 


g{X,0o)  dX. 


10.  An  application  to  simulated  data 

To  get  some  idea  of  how  the  Whittle  estimator  behaves  in  the  heavy  tailed 
situation,  we  ran  a  small  simulation  study.  Before  describing  the  results,  we 
make  some  comments  about  the  application  of  the  estimator. 
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Afl  noted  earlier,  in  application  it  is  the  estimator  based  on  the  summed 
periodogram,  that  is  used.  In  fact,  whereas  until  now  we  worked  with  the  self- 
normalised  sample  periodogram  In,Xt  in  practice  it  makes  more  sense  to  work 
with  the  regular  periodogram  ln,xW  dcAned  by 

n  * 

fn.xW  =  5^  Xte~‘*'  ,  -w  <A<  w. 

t=l 

In  this  case,  it  is  immediate  from  the  definition  of  that  it  could  have  also 
been  defined  as  the  minimiser  of 


where  the  sum,  as  before,  is  taken  over  all  Fourier  frequencies.  (The  difference 
between  and  e ^  lies  in  factors  of  n  and  the  normalisation  ^  Xj ,  neither  of 
which  affect  the  minimisation.) 

It  should  be  emphasised  that  minimisation  of  (10.1)  requires  knowledge  of 
neither  the  stability  parameter  a  nor  the  scale  parameter  a  of  the  data.  (This, 
of  course,  is  not  true  if  one  wants  to  determine  the  convergence  rate  of  the 
estimator.)  This  fact  has  two  important  consequences.  The  first  is  that  although 
there  exist  methods  for  estimating  stable  exponents  [e.g.  Dshapaiidze  (1986), 
Hahn  and  Weiner  (1991),  Hsing  (1991)  and  Koutrouvelis  (1980)]  none  of  these 
have  very  good  small  sample  behaviour,  and  so  it  extremely  comforting  to  have 
an  estimator  that  is  a  independent. 

The  second  consequence  is  that  since  it  is  well  known  that  the  Whittle  esti¬ 
mator  is  asymptotically  equivalent  to  the  MLE  in  the  Gaussian  case,  the  fact 
that  in  the  stable  case  the  Whittle  estimator  is  an  identical  function  of  the  data 
implies  a  robustness  property  for  both  the  Whittle  and  maximum  likelihood 
estimators  in  the  Gaussian  case  as  well. 

The  following  table  includes  the  result  of  a  small  scale  simulation  study.  We 
generated  100  observations  from  each  of  the  models 


1. 


Xt  -  0.4  X,.i  =  Zt 
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2.  Xt  —  Zf  +  0.8  Zt-i 

3.  X,-0.4X,_,  =Z.+0.8Z,_, 

where  the  innovations  sequence  {Zt)  was  either  iid  a-stable  with  a  =  1.5  and 
scale  parameter  equal  to  2.0,  or,  for  comparison  purposes,  ^(0,2).  (In  the 
stable  case  we  relied  on  the  algorithm  given  by  Chambers,  Mallows  and  Stuck 
(1976)  for  generation  of  the  innovation  process.)  We  ran  1,000  such  simulations 
for  each  model.  In  the  stable  example  we  estimated  the  ARMA  parameters  via 
the  estimator  0n ,  &nd  in  the  Gaussian  case  via  the  usual  MLE  estimator.  The 
results  were  as  follows: 


Model 

No. 

TVue 

values 

Whittle  estimate 

Maximum-likelihood 

mean 

St.  dev. 

St.  dev. 

1 

(p  =  0.4 

0.384 

0.093 

0.394 

0.102 

2 

0  =  0.8 

0.782 

0.097 

0.831 

0.099 

3 

<p  =  0.4 

0.397 

0.100 

0.385 

0.106 

0.736 

0.124 

0.815 

0.082 

Table  10.1:  Estimating  the  parameters  of  stable  and  normal  ARMA 
processes  via  Whittle  and  MLE  estimates. 

We  shall  not  attempt  to  interpret  these  results  for  the  reader,  but  merely 
point  out  that  the  accuracy  of  the  Whittle  estimator  in  the  stable  case  seems 
indistinguishable  from  that  of  the  MLE  in  the  Gaussian  case. 

Finally,  a  comment  about  estimating  p,  q,  a  and  the  scale  parameter  of  the 
stable  innovations.  We  have  assumed  throughout,  including  in  the  simulation 
above,  that  p  and  q  are  known.  When  this  is  not  that  case,  Bhansali  (1984, 
1988)  has  proposed  a  technique  for  estimating  p  and  q  that  seems  to  work  well 
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in  practice.  Estimation  of  o  can  be  done  either  from  the  raw  data,  or  from 
the  residuals  calculated  after  parameter  estimation.  Limited  experience  with 
simulations  indicates  that  it  is  best  done  on  the  (supposedly  iid)  residuals. 


Appendix 

In  Theorem  5.1.  we  proved  weak  convergence  of  the  estimated  coefficient  vec¬ 
tor  to  its  true  value  fio-  1°  finite  variance  case  this  holds  even  almost 
surely.  In  the  infinite  variance  case  (which  is  e.g.  satisfied  for  Zi  €  DA(a), 
a  6  (0, 2))  we  obtain  a.s.  convergence  under  a  more  restrictive  condition  if  we 
take  the  limit  along  a  well-specified  sequence  in  Af.  We  introduce  the  following 
condition: 


(A5)  There  exists  a  sequence  of  positive  numbers  Cn  such  that 

n 

limmf  =  1  a.s.  (AP.l) 

1=1 

where  the  norming  constants  Cn  satisfy  the  following  conditions;  There  ex- 

CO 

ist  some  <f  >  0  and  such  that  for  n*  ^  ^  (n*  c*"  +  )  <  oo 

for  5  =  1  A  d,  and  (cn/^nk)  >>  bounded  away  from  0  and  oo  uniformly  for 
n  €  [nt.ns.^]]  for  all  ife  €  AT. 


A  survey  of  results  of  type  (AP.l)  can  be  found  in  Pruitt  (1990,  p.  1149). 
Fristedt  and  Pruitt  (1971)  proved  under  the  restriction  E\Z\\*  <  oo  for  some 


d  >  0  that  (AP.l)  holds  with 


i  _  log  log  n 

"  *;(Cloglogn/n) 


(AP.2) 


for  some  constant  {  >  1  where  q(-)  =  logEe" 

If  Zi  £  DA{a)  for  a  £  (0,2)  we  deduce  from  (AP.2)  the  following  Lemma. 


Lemma  1  Suppose  F  £  DA{a),  a  £  (0,2).  Then  (AS)  is  satisfied  for  d<a 
and  ej*  =  L(n)  for  some  slowly  varying  fnnetion  L.  The  number  u  in  (AS) 
can  be  chosen  to  satisfy  v  >  a/{26  —  a)V  (o/6)  provided  6  >  o/2.  O 
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The  following  result  complements  Proposition  4.1. 

Proposition  2  Suppose  »»iufies  (Al),  (AS)  and  (AS).  Then 

7n».x(A)  ^  7{M.  fceA/’,  n-*oo. 


Proof.  We  use  the  decomposition  of  (8.1)  and  obtain 


max  1V,|  <52  52 1^*  I 

By  (Al),  (A2)  and  (AS)  we  obtain  for  all  e  >  0 

52  ^  ct"'“  1 

\n€[nfc.nA4.i)  /  n£[njb»nh4.i] 

oo 

<  cj52«^’*  "t+i  <  <» 

t=i 

for  some  ci,  cj  >  0.  A  Borel-Cantelli  argument  yields 


lim  max  lVi|e;®  =  0  as. 


Now  to  estimate  V2  set 


fi  =  (V’t+fc  -  7(^)  V’t)  • 


Then 

i>0  t=l  <<0  t=l 

=  V3  +  V4. 


We  restrict  ourselves  to  show  that  lim  er’Vs  =  0  a.s.,  the  proof  for  e'^l 

k->oo  * 

similar.  We  have 

^3  =  E/‘  E  2ti-T.fi  T2?+  E  f'  E  2}-  E  /• 

i>n  «=!-•  On  #=1  >S*<"  t=l-t  1<*<“  *— 


's  is 


E 

n  — i+l 


Vi-Ve  +  Vr-Vs. 
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We  restrict  ourselves  to  show  that  lim  e;^’  VV  =  0  a.s.,  the  proof  for  Vg,  Vg  and 
V|  is  analogoiu.  Again  by  (Al),  (A2)  and  (A5)  we  have 

f;  E  \e-:  Vr\*'^  <  cf;  ^  |/,|‘/»  |i|  <  oo 

Ssl  ksl  ^>0 

and  a  Borel-Cantelli  argument  yields  the  desired  result.  Similar  arguments  show 
that 

««»  Z  ^  Z*  +  0(1)  a.s. 

tsl  (zl 

So  we  obtain  as  in  (8.3)  that 

7fn.jr(A)  -  7(A)  —  0  a.s.  O 

A  result  similar  to  Proposition  2  for  Z\  €  DA{p)  was  obtained  by  Bhansali 
(1988).  The  following  example  shows  that  Proposition  2  is  in  general  not  valid 
if  the  subsequence  (ng)  is  replaced  by  (n). 

Example.  Consider  the  AfA(l)  process 

=  Z|  +  Zf_i ,  fCiV,  |J|  <  1 , 

for  a  symmetric  Zi  €  DNA{a)  for  some  a  €  (0, 2).  Then  as  mentioned  in  Sec¬ 
tion  2  (A1)-(A4)  and  (A5)  are  satisfied  where  («»)  can  be  chosen  as 

e„=n‘/»(loglogn)('-“/«'“  . 

Now  consider 

n— 1 

^izi+ezt-i}iz,+i+0z,) 

lal _ 

ft 

J^{Zt  +  9Zt.if 

tsl 

Z|  Zt+i  +  0  Zj_i  Zt+i  +  B  ^2  Z|*  +  B^  Zt_i  .Z( 

1=1 _ tel _ tel _ 1=1 _ 

n  ft  n  • 

Yi  z} + 53 

tel  tel  tel 


7n.jr(l) 
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Rxxinski  and  Woyczynski  (1987)  have  shown  that  for  some  c  >  0 
P  (Zi  ^2  >  *)  <  c  r-*  (1  +  log+  z-‘)  . 

Similar  arguments  as  in  the  proof  of  Heyde’s  SLLN  [see  Stout  (1974)]  and  the 
fact  that 

OO 

^P(Z,Z2>e^i)<oo 


h=i 


imply  that 


n-1 


e~^  (Zt  Zt^-i  ■+  0^  Zt  Z, .  I  +  S  Z|_i  Zt+i) 


lim 

n— •« 


1=1 


tsl 


=  0  a.s. 


Thus 


%.x(l)  = 


0  +  o(l) 


/  f«l 


a.8. 


(AP.3) 


+  0(1) 


We  shall  show  that 


lim  sup  Z^ 


:  OO  a.s. 


Define 


fn-l 
/  »=1 

An  -.=  {zl>e  }  .  B„  -=  Z}  <  n*'"  |  , 


(AP.4) 


then  for  every  c  >  0 

P  (zl  Zf  >  £  i.o.^  >P(A„n  B„  i.o.)  . 

OO 

Note  that  P  {An)  =  oo  and  liminf  P  (B„)  >  0.  Since  An  and  (Bi  ,B2,...,Bn} 

n=l  "■*“* 

are  independent  for  each  n  >  1,  an  application  of  a  standard  Borel-Cantelli 
lemma  [e.g.  Petrov  (1975),  Lemma  5,  Section  IX.2]  yields  P(An  O  B„  i.o.)  >  0, 
hence 


4 
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P(i4„nB„  i.o.)  =  1  which  implies  (AP.4).  From  (AP.3)  and  (AP.4)  we  con¬ 
clude  that  for  alriKwt  every  w  there  exists  a  subsequence  n'  =  n'(u)  such  that 


Hence  0  is  an  a.s.  limit  point  of  7n,jr(l)  ^ 

We  apply  the  above  Proposition  2  to  give  an  analogous  result  for  and 

finally  for  and  trj  (0„). 


Lemma  3  Supfost  (Xt)f^2  <a<ts/Ies  (Alj,  (At)  and  (A5).  Then  for  every  fixed 
6  >0,  uniformly  for  fi  and  for  5  =  0  and  0  EC 


r 


dX 


where  gi  and  ^  are  defined  as  in  Lemma  9.1. 


Proof.  It  follows  by  an  adaption  of  the  proof  of  Proposition  10.8.2  in  Brockwell 
and  Davis  (1991)  and  in  view  of  Proposition  2.  □ 


This  lemma  and  an  adaption  of  the  proof  of  Theorem  10  8.1  of  Brockwell  and 
Davis  (1991)  imply  the  following  result. 

Theorem  4  Suppose  **  **  causal  invertible  ARMA(p,q)  process  and 

conditions  (Al),  (AS)  and  (AS)  hold.  Then 
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